Comparison Inequalities and Fastest-mixing Markov Chains

نویسندگان

  • JAMES ALLEN
  • JONAS KAHN
چکیده

We introduce a new partial order on the class of stochastically monotone Markov kernels having a given stationary distribution π on a given finite partially ordered state space X . When K L in this partial order we say that K and L satisfy a comparison inequality. We establish that if K1, . . . ,Kt and L1, . . . , Lt are reversible and Ks Ls for s = 1, . . . , t, then K1 · · ·Kt L1 · · ·Lt. In particular, in the time-homogeneous case we have K L for every t if K and L are reversible and K L, and using this we show that (for suitable common initial distributions) the Markov chain Y with kernel K mixes faster than the chain Z with kernel L, in the strong sense that at every time t the discrepancy—measured by total variation distance or separation or L-distance—between the law of Yt and π is smaller than that between the law of Zt and π. Using comparison inequalities together with specialized arguments to remove the stochastic monotonicity restriction, we answer a question of Persi Diaconis by showing that, among all symmetric birth-and-death kernels on the path X = {0, . . . , n}, the one (we call it the uniform chain) that produces fastest convergence from initial state 0 to the uniform distribution has transition probability 1/2 in each direction along each edge of the path, with holding probability 1/2 at each endpoint. We also use comparison inequalities (i) to identify, when π is a given log-concave distribution on the path, the fastestmixing stochastically monotone birth-and-death chain started at 0, and (ii) to recover and extend a result of Peres and Winkler that extra updates do not delay mixing for monotone spin systems. Among the fastest-mixing chains in (i), we show that the chain for uniform π is slowest in the sense of maximizing separation at every time.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Eigenvalues of non-reversible Markov chains: their connection to mixing times, reversible Markov chains, and Cheeger inequalities

We show a lower bound on mixing time for a non-reversible Markov chain in terms of its eigenvalues. This is used to show a bound on the real part of the complex-valued eigenvalues in terms of the realvalued eigenvalues of a related reversible chain, and likewise to bound the second largest magnitude eigenvalue. A myriad of Cheeger-like inequalities also follow for non-reversible chains, which e...

متن کامل

Evolving sets, mixing and heat kernel bounds

We show that a new probabilistic technique, recently introduced by the first author, yields the sharpest bounds obtained to date on mixing times of Markov chains in terms of isoperimetric properties of the state space (also known as conductance bounds or Cheeger inequalities). We prove that the bounds for mixing time in total variation obtained by Lovász and Kannan, can be refined to apply to t...

متن کامل

Concentration Inequalities for Dependent Random Variables via the Martingale Method

Abstract: We use the martingale method to establish concentration inequalities for a class of dependent random sequences on a countable state space, with the constants in the inequalities expressed in terms of certain mixing coefficients. Along the way, we obtain bounds on certain martingale differences associated with the random sequences, which may be of independent interest. As an applicatio...

متن کامل

Mixing Time Bounds via the Spectral Profile Sharad Goel, Ravi Montenegro and Prasad Tetali

On complete, non-compact manifolds and infinite graphs, FaberKrahn inequalities have been used to estimate the rate of decay of the heat kernel. We develop this technique in the setting of finite Markov chains, proving upper and lower L mixing time bounds via the spectral profile. This approach lets us recover and refine previous conductance-based bounds of mixing time (including the Morris-Per...

متن کامل

Fastest Mixing Markov Chain on a Graph

We consider a symmetric random walk on a connected graph, where each edge is labeled with the probability of transition between the two adjacent vertices. The associated Markov chain has a uniform equilibrium distribution; the rate of convergence to this distribution, i.e., the mixing rate of the Markov chain, is determined by the second largest (in magnitude) eigenvalue of the transition matri...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011